An Online Learning Control Strategy for Hybrid Electric Vehicle Based on Fuzzy Q-Learning
نویسندگان
چکیده
In order to realize the online learning of a hybrid electric vehicle (HEV) control strategy, a fuzzy Q-learning (FQL) method is proposed in this paper. FQL control strategies consists of two parts: The optimal action-value function Q*(x,u) estimator network (QEN) and the fuzzy parameters tuning (FPT). A back propagation (BP) neural network is applied to estimate Q*(x,u) as QEN. For the fuzzy controller, we choose a Sugeno-type fuzzy inference system (FIS) and the parameters of the FIS are tuned online based on Q*(x,u). The action exploration modifier (AEM) is introduced to guarantee all actions are tried. The main advantage of a FQL control strategy is that it does not rely on prior information related to future driving conditions and can self-tune the parameters of the fuzzy controller online. The FQL control strategy has been applied to a HEV and simulation tests have been done. Simulation results indicate that the parameters of the fuzzy controller are tuned online and that a FQL control strategy achieves good performance in fuel economy.
منابع مشابه
A Novel Intelligent Energy Management Strategy Based on Combination of Multi Methods for a Hybrid Electric Vehicle
Based on the problems caused by today conventional vehicles, much attention has been put on the fuel cell vehicles researches. However, using a fuel cell system is not adequate alone in transportation applications, because the load power profile includes transient that is not compatible with the fuel cell dynamic. To resolve this problem, hybridization of the fuel cell and energy storage device...
متن کاملAn Online Q-learning Based Multi-Agent LFC for a Multi-Area Multi-Source Power System Including Distributed Energy Resources
This paper presents an online two-stage Q-learning based multi-agent (MA) controller for load frequency control (LFC) in an interconnected multi-area multi-source power system integrated with distributed energy resources (DERs). The proposed control strategy consists of two stages. The first stage is employed a PID controller which its parameters are designed using sine cosine optimization (SCO...
متن کاملOptimal power management of fuel cell hybrid vehicles
This paper presents a control strategy developed for optimizing the power flow in a Fuel Cell Hybrid Vehicle structure. This method implements an on-line power management based on the optimal fuzzy controller between dual power sources that consist of a battery bank and a Fuel Cell (FC). The power management strategy in the hybrid control structure is crucial for balancing between efficiency an...
متن کاملA Genetic-Fuzzy Control Strategy for Parallel Hybrid Electric Vehicle
Hybrid Electric Vehicles (HEVs) are driven by two energy convertors, i.e., an Internal Combustion (IC) engine and an electric machine. To make powertrain of HEV as efficient as possible, proper management of the energy elements is essential. This task is completed by HEV controller, which splits power between the IC engine and Electric Motor (EM). In this paper, a Genetic-Fuzzy control strategy...
متن کاملFuel consumption optimization of a series hybrid electric vehicle utilizing fuzzy logic control
The controller of the hybrid electric vehicle determines the combustion engine start-stop time, the operation points, and regenerative brake energy. The Controlling approach of hybrid electric vehicles controls the amount of needed fuel in every driving situation. In the present study, the thermostat strategy is implemented along with fuzzy logic control and compared to the classic thermostat s...
متن کامل